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{54} Information processing system using icons 

(57) A documentary information processing system for creating and editing a multimedia document. 
Document files are correspondingly associated with icons symbolizing them. Likewise, partial areas provided 
within a document are correspondingly associated with icons symbolizing them. On a screen, information 
(texts, graphs, etc.) within a partial area is deleted and replaced by an Icon. The icon is clicked for activation to 
return the information of the partial area symbolized by the icon onto the screen. There are two printing 
modes, that is a mode allowing the icon to be printed as it is, and a mode printing original information 
symbolized by an icon instead of the icon. It is possible to edit a document in editing units of icons. 
Interrelation can be defined among a plurality. of icons. 
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INFORMATION PROCESSING SYSTEM USING ICONS 



The present invention relates to information processing 
techniques using icons applicable to document creation/ 
editing systems such as word processors. 

An icon is displayed, on a display of a computer. A mouse 
is used to locate a cursor on the icon over the display. When 
the mouse is clicked in such a state, a file symbolized by the 
icon is opened to execute a function symbolized by the icon. 

Examples of the icons will be hereinafter described. For 
example, a text editing program is symbolized by an icon in 
the form of a notebook on the display. Also, functions in one 
program are symbolized by the icons. For instance, an icon 
in the form of a pencil which will appear during the execution 
of a plotting program symbolizes a function to input charac- 
ters or lines, while an icon in the form of an eraser symbol- 
izes a function to erase pictures or graphics. 

The manipulation by use of icons eliminates the necessity 
of directly inputting file names or commands to simplify the 
manipulation of the computer. 

A computer is utilized to create and edit a document. 
The word processor is an exclusive system for that purpose. 
Use of the computer such as the word processor ensures an easy 
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creation of a multi-media document. The multi-media document 
is a document including data of attributes such as image, 
graphics, and tables as well as texts consisting' of charac- 
ters and signs. 

Fig- 68 depicts an example of the multi-media document 4 
to be displayed on the display. The document 4 comprises a 
text area 5, an image area 6 and a graph area 7. 

For the insertion of an image, the mouise is manipulatied 
to set a "frame" having desired dimensions at a desired 
portion within the document. The frame serves to define the 
outline of an image area. Then, the imago as data is insert- 
ed into the frame. Also in the case of inserting a graph, 
table qr the like, the procedure is the same as the above. 
Further, the frame may be set to insert the text. 

An area defined by the frame and constituting a part of 
the document will hereinafter be called "partial area" . 

Conventionally, an icon corresponds only to whole docu- 
ment,, and does not to each partial area thereof. 

In the conventional system disclosed in Japanese Patent 
Laid-open Publication No. 11105/ 1992, a plurality of portions 
within one document can be displayed within respective wind- 
ows , and the results of the editing carried out in one window 
may affect the data within other windows. 

However, it has never been realized to link respective 
windows together by way of icons. 
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It is therefore an object of the present invention to 
enable icons to be set for each of partial areas in a document 
to thereby fully utilize the advantages of the icons to facil- 
itate the creation and editing of documents. 

Another object of the present invention is to allow the 
icons to be displayed on the document instead of data of the 
partial areas to thereby simplify the display of the document. 

A further object of the present invention is to diversify 
the print of the document containing the icons in response to 
the demand of the operator. 

A still further object of the present invention is to 
enable the relationship between two partial areas to be de-^ 
fined. 

In order to accomplish the above objects, an information 
processing system using icons in accordance with the present 
invention comprises: 

(a) means for storing the document; 

(b) means for displaying the document on a screen; 

(c) means for editing the document; 

(d) means for setting a partial area within the docu- 
ment ; 

(e) means for correspondingly associating the partial 
area with an icon symbolizing the partial area; and 

(f ) display control means for erasing the information 
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within the partial area on the screen to display the icon on 
the screen instead of the information. 

According to the above configuration, when the operator 
sets a part of an area (or a partial area) of a document by 
the use of a mouse or the like, an icon can be correspondingly 
associated with the partial area- Then, the display control 
means controls the display screen to erase the information 
within the partial area on the screen to display the icon 
instead of the information. In such case, the information 
within the partial area remains stored within the storag-e 
means merely without being displayed. 

According to thei present invention, the icons can be 
defined with respect to not only the entire document as in the 
conventional manner, but also respective partial areas within 
the document. Since the information within the partial area 
is symbolized by the icon, the display screen is simplified. 
In addition, editing can be realized by use of the icons as 
will be described later- 
According to one aspect of the present invention, the 
above-mentioned display control means has an area icon display 
mode and a position icon display mode- 

More specifically, the display control means in the area 
icon display mode erases information within the partial area 
while maintaining the areal configuration of the partial area 
to display an area Icon at any position within the partial 
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area. On the contrary, the display control means in the 
position icon display mode erases the entirety of the partial 
area together with the information involved therein to display 
a position icon at a position where the partial area was 
present. 

The display of the position icon enables the operator to 
easily understand the shape of the partial area, but necessi- 
tates a storage capacity sufficient to store the information 
on the shape of the -partial area. The display of the position 
icon merely allows the operator to recognize that at that 
position there is present a partial area having a certain size 
and a certain shape with a view of the position icon. In 
other words, the operator is merely capable of understanding 
the presence or absence of the partial area and the position 
thereof. Nevertheless, the position icon eliminates the 
necessity of a storage capacity sufficient to store the infor- 
mation on the size and shape of the partial areas. 

According to one aspect of the present invention. the 
system further comprises activation control means for allowing 
the Information within the partial region to return for the 
display on the screen when the activation. of the icon is 
specified. The term "activation" used herein means that the 
icon is erased from the screen to allow the information within 
the partial area corresponding to that icon to return onto the 
screen. 
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If a secret icon is set, the secret icon is activated 
only when a password specified for the secret icon coincides 

with an input password. 

When printing a document prepared by the present inven- 
tion, either a first print mode or a second print mode is 
selected . 

With the selection of the first print mode, the icon, if 
contained, is printed as it is at the time of printing: the 
the document- With the selection of the second print mode, 
the original information symbolized by the icon is allowed to. 
return for print instead of the icon at the time of printing 
the document. In the latter case, re-layout is carried out.il 
the position icon is contained. The first print mode advan- 
tageously shortens the printing time although the original 
information is not printed. The second print mode. is used in 
the case of. for example, printing a finished document. 

The present invention ensures editing of the partial are^ 
by use of icons since the partial area is symbolized by the 
Icon. For example, the move of the icon on the document 
causes a move of the information within the partial area 
symbolized by the icon, and likewise the deletion of the icon 
causes a deletion of the partial area symbolized by the icon. 
Hitherto, each time the partial area is subjected to the 
manipulation such as move, copy, or delete, the partial area 
had to be designated. According to the present invention, th 
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manipulation with respect to the icon after correspondingly 
associating the icon with the information within, the partial 
area will ensure a variety of information processing". 

According to one aspect of the present invention* an 
interrelation is defined among a plurality of partial areas. 
In compliance with the Interrelation, the change in the 
information within one partial area will be interlocked with 
the change in the information in the other partial area. 

The invention will be further described by way of 
non-limitative example, with reference to the accompanying- 

drawings, in which 

Fig. 1 is a block diagram' showing the entire . configura- 
tion of an information processing system using icons in accor- 
dance with, the present invention; 

Fig. 2 is^ a flowchart showing an example of an icon 

display process; 

Fig. 3 is a flowchart showing an example of an icon 

activation process; ' ^ ■ 

Fig. 4 is a flowchart showing an example of an icon print 

process; 

Fig. 5 illustrates three attributes of the icons; 

Fig- 6 is a diagram showing a first example of the icon; 

Fig- 7 is a diagram showing a second example of the icon: 

Fig. 8 is a diagram showing a third example of the icon; 

Fig. 9 depicts an example of a document displayed on a 
screen; 

Fig. 10 depicts the setting of a partial region. 



Fig- 11 depicts the selection of a position icon on a 

menu ; 

Fig. 12 depicts a position icon appearing in a document; 

Flff. 13 depicts an area Icon appearing in a document; 

Fig. 14 shows a first example of a relation between a 
document file and icon information; 

Fig-, 15 shows a second example of a relation between a 
document file and icon information; . 

Fig. 16 shows a third example of a relation between a 
document file and icon information; 

Fig. 17 shows a fourth example of a relation between a 
document file and icon information; 

Fig* 18 shows a fifth example of a relation between a 
document file and icon information: 

Fig. 19 is a diagram showing the setting of a partial 

area; 

Fig. 20 depicts the selection of an overlay icon on the 

menu ; 

Fig. 21 depicts the overlay icon appearing on the screen 
Fig- 22 depicts an example of a document containing data 
which are desired to be kept secret; 

Fig. 23 is a dlag:ram showing the setting of a partial 

area; 

Fig. 24 is a diagram showing the selection of the area 
icon on the menu; 
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Fig. 25 shows both the selection of a secret icon and the 
input of a password on the menu; 

Fig. 26 depicts the secret icon appearing on the screen; 

Fig. 27 is a diagram for explaining the activation of the 
secret icon; 

Fig. 28 is a diagram showing: the setting of a partial 



area; 

Fig. 29 depicts the selection. of the position icon on the 

menu; 

Fig. 30 depicts the selection of a table icon on the 

menu ; 

Fig. 31 depicts the table icon (serving also as the 
position icon) being displayed; 

Fig. 32 depicts the setting of a partial area surrounding 

an image ; 

Fig. 33 depicts the selection of the area icon on the 

menu; 

Fig. .34 depicts the selection of an image icon on the 

menu; 

Fig. 35 depicts the image icon (serving also as the area 
icon) being displayed; 

Fig. 36 is a diagram showing the setting of the partial 



areas ; 



Fig. 37 depicts the selection of the position icon on the. 



menu ; 
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Fiff. 38 depicts the selection of. a sound icon on the 

menu; 

Fie. 39 depicts the sound icon (serving also as the 
position icon) being displayed; 

Fi&. 40 is a diagram showing a document containing an 

icon; 

Fig. 41 is a. diagram for explaining the copy of the icon 
Fig. 42 is a diagram showing a document containing an, 

icon; 

Fig. 43 is a diagram for explaining the move of the icon 
Fig. 44 is a diagram showing a document containing an 

icon; 

Fig. 45 is a diagram showing the setting of . a partial 
area containing the icon; 

Fig. 46 depicts an icon B containing an icon A; 

Fig 47 is a diagram showing the relation among three 
icons ; 

Fig. 48 is a diagram showing the relation among four 
icons; 

Fig. 49 depicts the relation between a document file and 
icon information; 

Fig. 50 is a diagram showing the setting of a partial 

area; 

Fig. 51 depicts the setting of the position icon on the 

menu ; 
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Fi&. 52 depicts the position icon appearing on the 
screen; 

Fig. 53 depicts the selection of a graph icon on the 

menu; 

Pig 54 is a diagram for explaining the activation of a 
graph creation program; . 

Fig. 55 depicts the relation between a document file and 

icon information; 

Fig. 56 is a diagram for explaining the iconization of a 

partial area; 

Fig. 57 is a diagram for explaining that the activation 
of the icon automatically causes the activation of an applica 
tion program; 

Fig, 58 is a diagram for explaining the re-layout in a 

second print mode; 

Fig. 59 is a diagram showing a concrete configuration of 

a header part; 

Fig. 60 is a diagram for explaining the action of a 
processing section and application programs; 

Fig. 61 is a diagram showing a document containing a 
plurality of partial areas; 

Fig. 62 is a diagram showing an interrelation among a 
plurality of partial areas; 

Fig. 63 is a diagram showing an image area having a 
halved transverse length; 
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Fig. 64 is a diagram showing an image icon; 
Fig. 65.is a diagram showing an oval partial area; 
Fig. 66 is a diagram showing a triangular partial area; 
Fig. 67 is a diagram showing a partial area haying a 

complicated shape; and 

Fig. 68 depicts an example of a typical document con- 
taining an image and a graph. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring first to Fig. 1. there is shown an overall 
configuration of an Information processing system in accor- 
dance with the present invention, which is, in this embodi- 
ment, a word processor generally designated at 10. 

The system 10 of this embodiment has a feature to asso- 
ciate partial areas in a document with "partial area symbol 
icons" which correspondingly symbolize the areas. More 
specifically. the whole of a document file is correspondingly 
associated with an icon which symbolizes the file as in the 
conventional manner. whereas the partial areas are corre- 
spondingly associated with their respective partial area 
symbol icons (hereinafter, referred to simply as icons) . 

A processing section 12 essentially including a CPU and a 
plurality of programs is connected to an input section 14 
consisting of a mouse 16 and a keyboard 18. The mouse 16 
causing a cursor to move around on a display 20 is used to 
issue activation commands (double-clicked) to the icons. 
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Also, the mouse 16 is used to set the partial area, and the 
like. 

The processing section 12 is also connected to the dis- 
play 20. a printer 22 and a loudspeaker not shown which con- 
stitute an output section. The processing: section 12 is 
further connected to a document storage section 26 for storing 
document files, an icon information storage section 28 for 
storing icon information.- and a relational expression storage 
section 30 for storing relational expressions which define 
interactions among the partial areas. It. is to be noted that 
the document storage section 26 and the icon information 
storage section 28 are not required to be physically separate- 
ly provided, and that the document files may hold icon 
information. 

The processing section 12 is roughly grouped into three 
sections, that is. document editing 32. an icon management 34. 
and application execution 36. 

: The document editing section 32 has all the functions 
involved in the conventional word processor, and executes 
general processes for document creation and editing. That is, 
under its execution environment, the document editing section 
32 enables the operator to create texts and edit thus created 
texts by use of the keyboard 18, etc. 

The icon management section 34 for managing the display 
and activation of the icons correspondingly associated with 
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the partial areas in a document comprises an icon display 
control section 38, an icon activation control section 40, an 
icon editing: section 42, an inter-areal relationship defining 
section 44, and an icon print control section 46. 

The icon, display control section 38 is intended to exec- 
ute, for example, assignment of icons to the information in 
the respective partial areas, formation of icon patterns, and 
control of icon display onto the display 20. Fig. 2 illus- 
trates the action of the control section 38. 

In Fig. 1, if one of the icons being displayed is sub- 
jected to a double-clicked activation command, then the icon 
activation control section 40 allows the information within 
the partial area symbolized by the icon to appear on the 
display screen. Otherwise, the icon activation control 
section 40 controls, for example, an automatic execution of 
application programs. Fig. 3 illustrates the action of the 
control section 40. 

The icon editing section 42 in Fig. 1 carries out edit- 
ing control in editing units of icons, and, for example, 
permits the information within the partial areas to automati- 
cally move merely by the movement of the corresponding icon. 

The inter-areal relationship defining section 44 is 
intended for the definition of the interactions among the . 
plurality of partial areas. The obtained definition is 
stored within the relational expression storage section 30 in 
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the form of relational expressions. 

The icon print control section 46 functions to control 
the print of documents including icons. Fig. 4 depicts the 
action of the control section 46. 

In Fig. 1. the application execution section 36 comprises 
one or more application programs including, for example, a 
spreadsheet program, a graph creation program, a graphics 
creation program, an image processing program, and a sound 
processing program. These application programs may be locat- 
ed externally as well as inside the system. 

Referring next to Fig. 5, description will be given of 
attributes of icons which symbolize corresponding partial 
areas. 

The attributes of the icons are comprised of a layout 
attribute, a security attribute, and a multi-media attribute, 
as shown in Fig. 5. Each of the icons has these three at- 
tributes . 

The layout attribute relating to the layout of a document 
at the. time of icon display includes three types of Icons, 
that is. a position icon, an area icon, and an overlay icon. 

The position icon appears at the original position pf a 
partial area after erasing the whole of the partial area 
together with the information involved therein. In other 
words, this Icon indicates a position where a partial area is 
presently inserted into a document. When the position icon 
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is displayed, a chang-e is made to the layout of the document, 
and the information on the size and configuration of the 
partial area does not appear on the display-. 

The area icon differs from the above-described position 
icon in that it appears at any position within a partial area 
after the exclusive erasure of the information involved in the 
partial area. When this icon is displayed, the layout of the 
document is maintained, in other words, the areal config-ura- 
tion of the partial area rismain unchanged irrespective of the 
erasure of the information within the partial area. 

The overlay icon represents that the information within 
the partial area symbolized by the icon can be overlaid on the 
other information for the display or print thereof. 

These layout attributes can be represented by icon pat- 
terns or the like, and as shown in Fig. 5 by way of example, 
the position, area and overlay icons may be indicated as a 
circle, a square, or an inverted display . respectively . for 
the visual display of their attributes. 

The security attribute is related to the security of the 
information within the partial areas symbolized by the icons. 
The security attribute includes a normal icon and a secret 
icon. The normal icon can be activated without requiring any 
specific manipulation, whereas the secret icon is allowed to 
be restrictively activated only when passwords coincide with 
each other. For instance, tlie normal icon and the secret 
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icon are displayed at a normal brightness and a halved bright- 
ness, respectively. 

The multi-media attribute is related to the classes of 
information within the partial areas symbolized by the icons, 
and includes nine types of icon . A character icon indicates 
that the information within the partial areas is constituted 
of characters such as letters and signs, which is represented 

„ "A B " A table icon 

by a character array pattern A. a 

indicates that the information within the partial areas is in 
the form of tables, which is represented by a pattern with a 
rough ruled line. A graph icon indicates that the information 
within the partial areas is in the form of graphs such as a 
circle graph or a line graph, which is represented by a pat- 
tern symbolizing the graph. A graphics icon indicates that 
the information within the partial areas is graphic informa- 
tion, which is represented by a graphics consisting of com- 
bined simple typical graphics. An image icon indicates that 
the information within the partial areas is image information 
such as photographs , or facsimiles, which is represented by a 
sign "IM". A sound icon indicates that the information 
Within the partial areas is sound information such as a human 
voice, animal's cry. or computer-synthesized sound, which is 
represented by graphics representing the human mouth. An 
animation icon indicates that the information within the 
partial areas is animation information, which is represented 
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by a human-face pattern. An animated image icon indicates 
that the information within the partial areas is animated 
image information fetched through a television camera or the 
like, which is represented by a pattern imitating the tele- 
vision camera. A mix icon indicates that the information 
within the partial areas is combined information consisting of 
the above-mentioned plurality of pieces of information, 
which is represented by a pattern "MIX" • 

In this manner, the information symbolized by the icons 
is visually represented in the form of signs or pictures to 
enable the operator to easily recognize the attributes of the 
icons by merely viewing the icons. 

Figs. 6 through 8 illustrate examples of the icons. The 
icon shown in Fig. 6 includes the attributes of the position 
icon, the secret icon, and the character icon. The icon 
shown in Fig. 7 includes the attributes of the area icon, the 
secret icon, and the table icon. The icon shown in Fig. 8 
includes the attributes of the area icon, the normal icon, and 
the image icon. 

As discussed above, the icons each possess three attrib- 
utes, that is. the layout attribute, the security attribute, 
and the multi-media attribute. 

The patterns of the icons which are initially registered 
within the icon display control section 38 may be arbitrarily 
changed into, desired patterns. 
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The change in the icon patterns is made as follows. 

Although the icon patterns are registered in the system 
depending on their attributes as shown in Fig. 5. they may be 
changed by the operator if desired. The procedure comprises 
the steps of preparing a desirably configured icon by use of 
an icon pattern creating program not shown, storing it as one 
file in the system, selecting "pattern change" Indicated by a 
broken line in Fig. 43 with an icon appearing on the screen, 
and inputting the file name. storing the configuration of the 
icon. Thus, the original icon pattern can be replaced by an 
arbitrarily prepared icon pattern. 

Referring next to Figs. 9 through 13 in connection with 
Fig. 2, description will be given of the action of the icon 
display control section 38. 

Fig. 9 illustrates, by way of example, a document 142 
appearing on a screen 140 of the display 20. A menu 144 
located at the bottom of the screen 140 indicates various 
functions which are selected through the manipulation of the 
cursor or the like. The menu display is not limited to the 
illustrated example, but may be located at the top of the 
screen, or alternatively a so-called pull-down menu may be 
employed. 

In order to set a partial area for such a document 142. 
"rsuige" is selected on the menu 144, and the range of a par- 
tial area 146 within the document 142 is designated by a 
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frame 152 (SlOl in Fig*. 2). Then, the next menu 144 indicate 
words, "copy", "move", "delete", and "icon". If selecting th 
words other than "icon", a greneral editing- process (S103) is 
executed. 

The "icon" in the menu 144 represents a process corre- 
spondingly associating the thus designated partial area with 
an icon. If selecting the "icon" (S102) , then the next menu 
indicates "position", "area". and "overlay" as shown in Fig. 
11, In this case, the "position", "area" and "overlay" allow 
the selection of the position icon, area icon and overlay 
icon, respectively. For instance, the "position" is selected 
(S104). 

Herein, description will not be given of the setting" of 
the secret icon (S105, S106) and of the selection of the 
multi-media attributes (S107) in Fig. 2. 

A ser.ies of processes from SlOl to S105 in Fig. 2 enable: 
the icon display control section 38 to create the icon infor- 
mation (S112) . 

If the "position" is selected at S104 in Fig. 2, the 
process will be diverged at S108 for the execution of S109. 
More specifically, the whole of the partial area 146 designat 
ed in Fig. 10 disappears on the screen together with the 
information involved therein as shown in Fig. 12, but instead 
a position icon 148 appears at the position where the partial 
area was originally present (S109). That is, when the posi- 



20 



tion icon 148 is displayed, the areal configuration of the 
partial area disappears to permit the text behind the partial 
area to move toward the text in front thereof, which results 
in a change in the. layout. In the Fig. . 12 example, the 
partial area of a plurality of lines is erased, and the posi- 
tion icon appears on the left end of the first line of the 

original partial area. 

On the contrary, if "area" is selected in Fig. 11 (S104) 
the information (for example, a text) within the partial area 
146 is erased, but the area of. the partial area 146 remains 
unchanged, allowing an area icon 50 to be displayed on the 
top left of the area (SllO) as shown in Fig. 13 where refer- 
ence numeral 52 denotes a frame defining the partial region. 

On the other hand, the display of the overlay icon is 
carried out as follows. As shown in Fig. 19. the entire 
format of a bill issued by the. ABC company is designated as 
the range of the partial area (SlOl). Afterwards, the "icon- 
is selected from the menu (S1G2) . and then the "overlay" is 
selected from the menu (S104) as shown in Fig. 20. At that 
time, as shown in Fig. 21. the format of the bill shown in 
Fig. 19 is erased and succeeded by. the overlay icon 53 appear 
ing in a black-white inverted pattern on the left top of the 
screen (Sill) . 

Afterwards, into the space of the partial area where the 
format of the bill was originally present. there are input 
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the name of the company which is an addressee of the. bill, 
goods, quantities, and amounts of money* 

In order to print this document, the input data for the 
bill (refer to Fie. 21) is overlaid on the format of the bill 
(refer to Fig. 19). It is natural that the double-clicked 
activation of the overlay icon 53 ensure an overlaid display 
of two such pieces of information. 

Fig. 14 illustrates, by way of example, a file organiza- 
tion of a document. Icon information 56a and 56b shown in 
Fig. 14 are to be prepared by the icon display control sectio 
36. The icon information 56a and 56b each comprise a header 
part 58 and a data part 60. The header part 58 includes 
management information associated with the icon as shown in 
F:ig. 59 later-, while the data part 60 includes the informatlo 
within the partial area symbolized by the icon and read out 
at the time of screen display and printing. This icon infor- 
mation is stored within the Icon information storage section 
28 shown in Fig. 1. 

Fig. 15 through 18 depict other examples of management c 
the icon information 56. In Fig. 15. the icon information 
56a, 56b is inserted into the document file A in the same 
manner as the Fig. 14 example. This means that the document 
information and the icon information are managed in one file. 
In Fig. 16 example, the document information and the icon 
information 56a, 56b are separately managed in their respec- 
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tive files. A pointer by which the file B of the icon infor- 
mation 56a, 56b are specified is inserted into the document 
file A. Although the plurality of pieces of icon information 
56a and 56b are stored within one file B in the example shown 
m Fig. 16. the icon information 56a and 56b are separately 
stored within their respective files B and C in the example 
shown in Fie. 17. In the example shown in Fig. 18. on one 
hand the icon information 56a is stored within the document 
file A. whereas on the other hand the icon information 56b is 
stored within the separately provided file B. 

Any storage form of the icon information 56 may be em- 
ployed as long as the relationship between the document and 
the partial area is specified. 

The secret Icon will now be described with reference to 

Fig. 22 through 26. 

The data shown in Fig. 22 are personal evaluation data 
whose disclosure must be restricted to specified persons. To 
this end. the secret icon is utilized. 

In Fig. 22. the "range" is selected from the menu (SlOl) , 
and then the partial area is set by use of a frame as shown in 
Fig. 23 (S102). In other words, the range (which is required 
to be kept secret) is framed. Then, the "area" is selected 
on the menu as shown in Fig. 24 for the selection of the area 
icon (S104) . 

This allows the display of the menu for selecting whether 
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that partial area is to be kept secret or not. If secret, th 
icon "secret" is selected (S105) to leave the system waiting 
for the input of the password consisting- of four characters. 
Then, the password is input through the keyboard (S106). so 
that the information within the partial area is erased as 
shown in Fig*. 26 to allow the secret icon 60 to appear in 
halved brightness (SllO). Subsequently, the secret icon 60 i 
not permitted to be activated as long as the password is 
input, to thereby ensure the protection of the data to be kep 
secret. 

On the contrary, in order to display the information 
within the partial area by the activation of the secret icon 
60, the secret icon is clicked by use of the mouse (S201 in 
Fis. 3). Then, the icon activation control section 40 judges 
the icon to be a secret icon (S202) to change the menu on th 
screen into the password waiting state as shown in Fig- 27. 
Then, the input of the password is effected (S2p3) . If the . 
input password coincides with the registered password (S204), 
then the "activation" is input (S205) to enable the display o 
the information symbolized by the secret icon {S208). If the 
secret icon is required to be changed into the normal icon, 
"secret release" is merely selected after the input of the 
password at the stage shown in Fig. 27 (S205, S206) . If it i 
desired to change the password which has been already regis- 
tered, "password change" is selected after the input of the 
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password (S205). and a new password is input thereinto (S207) . 

The following is a description of typical examples (the 
table icon, image icon, and sound icon) of the multi-media 
attribute. 

Fig. 28 illustrates a list showing the results of foot- 
ball games. The table icon is displayed by the procedure 
comprising the steps of subjecting the table to the designa- 
tion of the partial area (SlOl). selecting the icon display 
(S102), selecting. the position icon as shown in Fig. 29 
(S104). and selecting "table" as the multi-media attribute as 
shown in Fig. 30 (S107) to allow the table icon 62 to be ■ 
displayed as shown in Fig. 31 (S109) . It is to be. noted that 
the multi-media attribute may be automatically judged by the 
icon display control section 38 at S107 in Fig. 2. with the 
omission of S107. The order of selecting the three icons is 
not limited to that shown in Fig. 2. 

Fig. 32 illustrates a document including an image. The 
image icon is displayed by the procedure comprising the steps 
of subjecting the image to the designation of the range 
(SlOl). selecting the "icon" on the menu (S102). selecting the 
"area" (area icon) on the menu as shown . in Fig. 33 (S104) . and 
selecting the "image" on the updated next menu (5107) to allow 
the image icon 64 to be displayed as shown in Fig. 35 (SllO). 

Fig. 36 depicts a document including a text consisting of 
questions and their answers. The sound icon is displayed by 
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the procedure comprising the steps of subjecting, for example 
two question portions constituting the text data to the desig 
nation of the range (SlOl), selecting, the "icon" on the menu 
(S102). selecting the "position" on the menu as shown in Fig 
37 (S104). and selecting the "sound" on the menu as shown in 
Fig. 38 (S107) to allow the sound icons 66a and 66b to be 
displayed as shown in Fig. 38 (S109). 

When the sound icon 66 is double-clicked (S201), the 
icon activation control section 40 judges the necessity of 
executing an application program (AP) to, if necessary, 
activate the AP (in this case, sound synthesis program) 
(5208), thus allowing the text data symbolized by that sound 
icon to be converted into voice signals for the output of 
voice through the loudspeaker not shown. In this example, 
the questions are output as V9ice since they undergo the 
designation of the range. 

The following is a description of functions of the icon 

editing section 42. 

In the system 10 of this embodiment, the icon may be the 
object of editing. For the copy of the information within 
the partial area, the "range" is first selected to specify ar 
icon 68 itself as shown in Fig. 40. Then, the "copy" is 
selected with the destination thereof specified as shown in 
Fig. 41, to thereby copy the icon 68 to produce an icon 70. 
In this case, the copy of the icon means a copy of the infor- 
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mation; symbolized by the icon, which ensures a simple editing 
by use of the icons without directly subjecting the informa- 
tion within the partial area to the designation of the range. 

on the contrary, for the movement of the partial area, 
"range" is selected from the menu to specify an icon 72. 
Then, "move" is selected from the menu to specify the destina- 
tion of the movement. Thus, the icon 72 is moved to the 
specified destination together with the partial area as shown 
in Fig. 43. 

The case where the icon includes other icons will be 

hereinafter described. 

AS shown in Fig. 44. the "range" is selected on the menu 
with the icon A being displayed. Then, as shown in Fig. 45. 
the area including the icon A is framed for the designation of 
the range. , Then, the "icon" is selected to allow a new icon B 
to be displayed as shown in Fig. 46. Here, the icon B includes 
the parenthesized icon A. thus clarifying the relation bet- 

ween the two icons. 

Figs. 47 and 48 depict other examples. In the example 
shown in Fig. 47. the icon A includes both the icon B and an 
icon C. and is expressed as "A (B. O". On the other hand, 
in the example shown in Fig. 48. the icon A includes both the 
icon B and the icon C. the icon B further including the icon 
D. whose relationship is expressed as "A (B (D) . O". In this 
manner, a partial area may further include another partial 
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area. 

Flff. 49 depicts a file format. A document file 54 in- 
cludes the icon information 56a of the icon A which in turn 
includes the icon information 56b of the icon B and an icon 
information 56c of the icon C. 

Description will next be given of the activation of the 
application programs. The example described hereinbelow 
differs somewhat from the process shown in Fi&s. 2 and 3 in 
that the selection of the multi-riiedia is carried out at the 
time of icon activation. 

In the case of inserting, for example, a graph into a 
document, a partial area is first set as shown in Fig. 50. 
Then, the "icon" is specified on the menu, and the "position" 
is selected on the menu as shown in Fig. 51 to allow a posi- 
tion icon 74 to be displayed as shown in Fig. 52, It is to b< 
appreciated that this icon undergoes only the designation of 
the layout attribute but does not undergo the designation of 
the multi-media attribute. Therefore, the position icon is 
constituted of a simple circle. 

When the icon 74 is activated, the menu shown in Fig. 53 
appears since the multi-media attribute has not yet been se- 
lected. Then, the "graph" is selected. Thus, a graph is 
displayed in the icon 74 to form a graph icon 76 as shown in 
Fig- 54, while at the same time automatically activating a 
graph creation program. In Fig. 54 example, the activation oj 
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the program allows an application window 78 separately from an 
editing window 77 to be opened. 

For example, a menu for creating the graph is displayed 
within the window 78 in accordance with this graph creation 
program. Thus, for example, the operator selects "bar graph", 
and inputs "class" as a parameter of x-axis, and "the number 
of persons" as a parameter of y-axis. Then, "A, B, C" are 
input as specified class data, and "40, 50, 30" are input as 
the data of the number of persons corresponding to the class. 
Thus, within the window 78 there appears a graph created 
based on the above-mentioned data . input. 

The termination of the graph creation program permits the 
graph within the window 78 to be stored into icon Information 
56 of the icon 76. 

Fig. 55 depicts an example of a file format in that 
instance. The icon information 56 is inserted into the docu- 
ment file. The icon information 56 comprises a header part 58 
and a data part 60. The data part 60 includes display / print 
data composed of a graph image, and source data 82 which has 
been input for the creation of the graph. In the case where 
specifications for the display data are different from those 
for the print data, the display data and the print data may be 
separately stored. 

The activation of the thus set icon automatically ensures 
the activation of the graph creation icon and opening of the 
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window. Any necessary modification and editing may be made 
within the window. Where the graph creation program is termi- 
nated after the modification of the graph, the icon informa- 
tion is modified. 

According to the system of this embodiment, a partial 
area is set partly in the document so that the partial area 
can be correspondingly associated with an icon. More specifi- 
cally, as shown in Fig. 56. the designation of a graph in a 
document as its partial area enables an icon symbolizing the 
graph to be displayed instead of the graph. This may be 
called "iconization" of the partial region. 

According to the system of this embodiment, as shown in 
Fig. 57, the activation of an icon enables the information 
within the partial area symbolized by the icon to return onto 
the screen. In such case, if the activation of a specified 
application program is associated with the information within 
the partial region, the activation of the icon may automati- 
cally result in the activation of the application program. 

The following is a description of the action of the icon 
print control section 46. 

The icon print control section 46 has a first print mode 
and. a second print mode. The first print mode allows the ico: 
to be printed as simple graphics at the time of printing a 
document (S302 in Fig. 4). On the contrary, the second print 
mode, if an icon is contained, allows the information within 
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partial area symbolized by the icon to be printed back upon 
printing the document (S307) . In other words, the icon is 
printed in the first mode, but is not printed in the second 
mode . 

It is judged at 5303 in Fig. 4 whether a secret icon is 
included within the document or not. Control may be then 
passed through S304 where the input of a password is performed 
by the operator to S305 for judging whether thus input pass- 
word is coincident with the registered password. 

The first print mode ensures a shortening of the printing 
time- since the icon is printed as it is with the omission of 
print of the complicated graph or the image. On the contrary, 
the second print mode ensures a print, of a perfect document. 
When printing the overlay icon in the second print mode, two 
data are superimposed together for printing. 

In the case where a position icon is contained in a 
document, an attempt to print the document in the second print 
mode may result in a difficulty in printing with a superior 
layout. For this reason, the icon print control section 46 
has a re-layout function to cope with such case (S306) . 

Fig. 58 depicts a document containing a position icon 
having as its data a graph 80- If the document is printed in 
the second print mode, the data existing behind that icon may 
be printed over two contiguous pages which may impair the 
continuity of the data displayed. For this reason, this 
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embodiment carries out a re-layout if desired in view of such 
a case. For example, as shown in Fig. 58, a graph is printed 
on the first page, and text is printed on the second pag-e eve 
if a blank portion remains on the first page. 

Re-layout may be carried out by a variety of methods. I 
is however preferred that data such as a graph or an image 
having a display continuity are not allowed to be printed 
over two contiguous pages. To this end, there may be provid 
ed a step of Judging the data requiring a display continuity 
so that the re--layout can be effected if it is judged that th- 
re-layout is necessary. 

Description will next be given of the functions of the 
header part 58 constituting the icon information. Fig. 59 
illustrates a concrete construction of the header part. 

"Identifier" 81 is identification information for identi- 
fying the attribute of the icon. The attribute of each icon 
is identified by referring to the "identifier". 

"AP file name" 82 is a file name of an application pro- 
gram correspondingly associated with an icon. At the time o: 
activation of the icon, the icon activation control section 4f 
refers to the "AP file name". 

"Source data file name" 83 is a name of a file storing 
data used as a base for the execution of the application 
program. As shown in Fig. 55, the source data 82 is ordinar- 
ily stored within the icon information, but may be stored 
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within other files by utilizing the "source data file name" 
83. 

"Pass name of AP file name / source data file name" 84 is 
a pass name to which a reference is made when accessing a file 
of an application program. "Pass name of source data file 
name" is a pass name to which a reference is made when access- 
ing a file designated by a source data file name. 

"Display / print data .size" 85 is a memory size of data 
for the display and print. Where the display data differ in 
size from the print data, respective sizes are separately 
stored. 

"X size and Y size" 86 and 87 indicate the vertical and 
transverse lengths in the case where the display / print data 
are displayed on the screen or printed on print paper. 
Where the display data are different in size from the print 
data, respective sizes are separately stored in the units of 

cm. inch, or BMU. 

"Source data format" 88 indicates a data format of the 
source data. The source data format to be specified includes 
a text file format in ASCII c6de. SYLK format, TIFF format. 
GKS format. CORE format and CIS format. It is preferable to 
employ the data format compatible with the other application 
programs. 

"Display process class" 89 is a flag for identifying 
whether to display the icon or the data such as a graph or a 
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chart created by the application program. The "display pro- 
cessing: class" 89 enables an arbitrary display manner to be 
set. 

"Display process activation timing" 90 indicates a timing 
to display a process result of an application program. It is 
to be understood that the timing may include, for example. 

(i) when a distinctive activation, instruction from the user 
is received; 

(ii) when a document editing process is started; 

(iii) when data is loaded; and 

(iv) when the document editing process is terminated. 

"Icon file name" 91 is a file name storing a pattern of 
an arbitrarily prepared icon. 

"Print application file name" 92 is a file name of a 
print application program to be activated, if present, which 
is to be designated when a document is printed. 

"Print activation timing" 93 is a timing to execute a 
print, the timing including, for example, 

(i) when a distinctive activation instruction is received 
from the user; 

(ii) when a document editing process is started; 

(iii) when data is loaded; and 

(iv) when the dpcument editing process is terminated. 
"Print process class" 94 is intended to specify the print 

modes described above. 
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"AP area" 95 is an area to be used by the user applica- 
tion program, which, if necessary, may store information such 
as version names, area names, -comments, etc. 

"Password" 96 is to be set for a secret icon. 

"Termination identifier" 96 means the termination of the 
header part. 

The following is a description of the execution of appli- 

cation programs. 

Fig. 60 diagramatically shows the interrelation among the 

icon information 56. the application programs 36. and the 
processing part 12. It is to be noted that in the configura- 
tion of Fig. 1 the application programs 36 lie inside the 
processing part 12. but that in the configuration of the 
application programs 36 lie outside the processing section 12. 

When the processing unit 12 detects a double-click for an 
icon by the operator, it judges whether an application program 
has been designated or hot with reference to the icon informa- 
tion of that icon (SI). If it is judged that the designation 
is present, the processing unit 12 activates the application 
program 36 designated by the "AP file name" of the icon infor- 
mation 56. and it stands by until the termination of the 
application process (S2) . When the application process is 
terminated and the processing section 12 receives a notice 
that the program has. duly terminated, the processing section 
12 controls to store" the execution results of the application 
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program 36 into the data parts 80 and 82 within the icon 
Information 56. It is to be appreciated that if the applica- 
tion progrram has been unduly terminated the data parts 80 an( 
82 are not updated. In the case where the processing section 
12 itself comes to an abnormal termination or compulsory- 
termination during the execution of the application program 
36, the processing section 12 sends out signals indicating 
such state to the application program 36. 

Further description will now be given of the execution ol 
the application programs 36. If the data format to be dealt 
with by the application program 36 differs from the data 
format used in the processing section 12, then the applicatior 
program 36 serves to convert the data format into its own data 
format with reference to the "source data format" 88 (S3) . 
Then, the thus converted date are subjected to the applicatior 
process. Afterwards, the application program 36 feedbacks to 
the processing section 12 whether the application process has 
terminated duly or unduly. 

It will be understood that the data sections 80 and 82 
axe updated by the processing section 12 in the above, but 
that they may be updated by the application program 36 in 
accordance with its execution results. 

The configurations of the icon information are not con- 
fined to the examples shown in Figs. 14. 49 and 60. and the 
data which are the execution results of the application pro- 
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gram may be stored within separate files. In that instance, 
the file name to store the execution results must be regis- 

•tered in the header part 58. 

The operation of the Inter-areal relation defining sec- 
tion 44 will be hereinafter described. In Fig. 61. reference 
marks are imparted to respective partial areas. The document 
A includes a partial area B. partial area C and partial area 
D. where the partial area B is a graph area, the partial area 
C is a graphics area, and the partial area D is a table area. 

Among the respective areas there are established rela- 

tional expressions: 

(a) area B = graph (area D) 

(b) area C = graphics (area D) 

(c) area A = area B + area C * area D 

The expression (a) means that the graph in area B is 
prepared from table data in area D. The expression (b) means 
that the graphics in area C is prepared from the table data in 
area D. The expression (c) means that the area A consists of 
the area B. the area C and the area D. 

in this manner, the definition of the interrelation in 
the form of relational expressions enables data of one area to 
be produced from the data of the other area, and enables the 
change in data content of one area to be interlocked with the 
change in the data content of the other area. 

For example, the change in the data content of the area D 
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results in the change in the data content of the areas B and 
C. 

Fig. 62 depicts the setting of the relational expressions 

usiiig the icons . 

As shown, the icon A is correspondingly associated with 
the application program for the creation of the table, and 
likewise the icon B is correspondingly associated with the 
application program for creating the table, each having table 
data. Herein, if the relational expression 

(d) C = graph (A + B) 
is defined, then the icon C is allowed to be correspondingly 
associated with a graph creating application program, thus 
displaying as a graph the results obtained by adding the table 
data of the icon A and the table data of the icon B together. 
In the case where a change is made in the table data of the 
icon A or B. the application program serves to change the 
graph based on the modified table data in accordance with the 
above calculation expression. 

The present invention Is not limited to the above- 
described examples in which the iconized partial areas are se- 
in units of lines. 

In the example shown in Fig. 63, a human face is insertei 
into a document as an image. The image area has a transverse 
dimension equal to half of one line. When iconizing this 
image area, there appears an image icon (a position icon) as 



38 



shown in Fig. 64. Herein, a text (O immediately behind the 
image area is allowed to move to the right side of the image 



icon. 



Providing that the original areal configuration informa- 
tion is to be contained within the icon information of the 
icon, there can be obtained a document as shown in Fig. 63 
with the original layout when the icon is activated. 

Referring to Fig. 65. an image area of oval configuration 
is inserted into the document, which area may also be icon- 
ized. Likewise, there may be iconized such a triangular image 

area' as is shown in Fig. 66. 

Further. there can be also iconized a more complicated 
area as shown in Fig. 67. In this case, the graphics data 
prepared by use of a graphic creating unit can be wholly 
utilized as data for the area to be iconized. 

If the area having a complicated configuration is icon- 
ized as a position icon, the layout may be come deformed. The 
system is therefore so controllable as not to subject such a 
complicated area to the selection of the position icon. 



39 



CLAIMS 

1. A system for processing information of a document, com- 
prising-.: 

means for storing said document; 

means for displaying- said document on a screen: 

means for editing said document; 

means for setting a partial area within said docu- . 

ment; 

means for correspondingly associating said partial 
area with an icon symbolizing said partial area; and 

display control means for erasing the information 
within said partial area on the screen to display said icon o] 
the screen instead of said information. 

2, A system for processing information of a document accord- 
ing to claim 1. wherein . 

said display control means has an area icon display mode 
and a position icon display mode. 

said display control means in said area icon display mod< 
erasing information within said partial area while maintainini 
the areal conf ig:uration of said partial area to display an 
area Icon at any position within said partial area; 

said display control means in said position icon display 
mode erasing all of said partial area together with the infor- 
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mation involved therein to display a position icon at a posi- 
tion where said partial area was present; 

said area icon display mode being intended to maintain 
the layout, and said position icon display mode being intended 
to change the layout . 

3. A system for processing information of a document accord- 
ing to claim 2. further comprising: 

activation control means for allowing the informa- 
tion within said partial region to return for the display on 
the screen when the activation of said icon is specified. 

4. A system for processing information of a document accord- 
ing to claim 3. further comprising: 

means for setting a secret icon: 
said activation control means activating said secret icon 
only when a password specified for said secret icon coincides 
with an input password. 

5. A system for processing information of a document accord- 

ing to claim . 1, 2, 3 or 1, further comprising: 
means for printing said document; 

means for selecting either a first print mode or a 

second print mode; 

print control means for controlling said print means. 
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said control means in the selection of said first print mode 
allowing said icon to be printed as it is at the time of 
printing said document, said control means in the selection o 
said second print mode allowing the original information 
symbolized by said icon be printed instead of said Icon at th 
time of printing said document. 

6. A system for processing information of a document accord- 
ing to claim 5, wherein 

said print control means carries out the. re-layout if 
said position icon is contained when printing in said second 
print mode. 

7. A system for processing information of a document accord- 
ing to any one of the preceding claims, further comprising: 

icon editing means for the execution of editing 
including move, copy and delete of said partial area in edit- 
ing units of said icons. 

8. A system for processing information of a document accord- 
ing to any one of the preceding claims, further comprising: 

means for storing an interrelation among a pluralit 

of partial areas; and 

means for changing the information in one partial 
area in connection with the change caused in the other partia 
area in accordance with said interrelation. 
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. „et.oa o. pr.«ss.„. in.or„aU.. o. a document, co.pr.s- 

ing the steps of: 

(a) displaying said document on a screen; 

. « ...rtial area within said document; 

(b) designating a partial are , ^. 

. r>artial area with 

(o) correspo.dln.ly associating saad partial 

an icon; and orea to 

(a, erasln. t.e Information within said partial 

display said icon instead. 

. .et.od o. processing Information of a document, com- 

prising the steps of: ^ h rtnru- 

• ,a) correspondingly associating the whole of sa.d docu 

„.ent With an icon: and ^ ^^.^ 

(b) correspondingly associating a partial ar 

document with an icon. . 

11. An information processing system constructed and 
arranged to operate substantially as hereinbefore described 
with reference to and as illustrated in Figures 1 - 67 of 
the accompanying drawings. 

12. A method of processing information substantially 
as hereinbefore described with, reference to and as 
illustrated in Figures 1 - 67 of the accompanying drawings. 
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